maybe the fitting just wasn't machined correctly to sit flush on the pump? Perhaps remove and eyeball it up with a metal straightedge to check for this issue?
There might be some kind of RTV that can be applied to plug things up? Maybe Permatex Copper which is pretty sturdy stuff?
Certainly would be a pain to pull that part and return it....